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METHODS OF PROCESSING AND DISPLAYING IMAGES AND DISPLAY 

DEVICE USING THE METHODS 

The invention relates to a device and to a method for displaying 

5 images. 

The visual contents, whether these be fixed or moving images, are 
in general creations that benefit from guarantees of exclusivity associated 
with the creator's rights. Their reproduction Is in general permitted only within 
a strictly defined framework that allows the creators and their beneficiaries to 

10 be remunerated. 

To ensure that these legal rules are complied with correctly, many 
systems have been developed to prevent Illegal copies or to make the quality 
of the copies sufficiently degraded to make them unusable. 

Within this context, Patent Application EP 1 237 369 aims to 

15 combat the copying of images by means of a camera while they are being 
displayed, for example using a camcorder in a cinema. For this purpose, it 
has been proposed to modulate the intensity of the pixels with a feature 
around the value to be displayed at a high rate that makes the feature 
invisible to the human eye but generates artefacts in the sequence filmed by 

20 the camcorder. 

Such a solution requires modulation at a rate higher than the flicker 
fusion frequency, which is of around 60 Hz, and therefore applies only to 
systems having a high image refresh rate, at least of around 100 Hz. Applied 
to systems with a lower display rate (50 Hz or 60 Hz for example), the 

25 modulation could be visible to the human eye and would visibly degrade the 
rendition of the displayed image. 

To avoid these problems, and especially to propose a solution that 
applies to a wider range of display devices, the invention proposes a method 
of processing a source image generating at least two successive processed 

30 images, in which the colour of at least one pixel in each processed image is 
different from the colour of the pixel in the source image, and in which the 
modified colours of the pixel in each processed image offset each other in 
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order to obtain a colour corresponding to the colour of the pixel in the source 
image. 

The images are thus altered without this being prejudicial to the 
rendering as regards the human eye, even at relatively low rates compared 
5 with the prior art. 

Preferably, the luminance of said pixel in each processed image is 
equal to the luminance of the pixel in the source image. 

According to the same concept, the invention proposes a method 
of processing a first set of images that generate a second set of images, in 
10 which the colour of at least one pixel in the first image of the second set is 
different from the colour of the pixel in the first image of the first set and in 
which the resulting colour of the pixel in the images of the second set is the 
resulting colour of the pixel in the images of the first set. 

Preferably, the luminance of said pixel in the first image of the 
15 second set is equal to the luminance of the pixel in the first image of the first 
set. 

In general, the colour of a pixel is defined by the chrominance of 

said pixel. 

The invention thus proposes a method of processing at least one 
20 source image into a plurality of processed images, comprising the steps of: 

- modification of the chrominance in at least one pixel of the source 
image; and 

- calculation of the chrominance of said pixel in the processed 
images, in such a way that the average of the chrominances of said pixel in 

25 the processed images is equal to the average of the chrominances of said 
pixel in the image source or sources. 

The luminance of said pixel is preferably unchanged. 
Employed for displaying, the invention therefore proposes a 
method for displaying images on the basis of at least one source image, in 
30 which a plurality of images are displayed in succession and in which, in at 
least one pixel, the colour of the displayed images is different from the colour 
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in the source image and the resultant of the colours of the displayed images 
Is the resultant of the colour in the source image. 

In terms of the device, the invention proposes a device for 
displaying images on the basis of at least one source image, in which a 
5 plurality of images are displayed in succession and in which, in at least one 
pixel, the colour of the displayed images is different from the colour in the 
source image and the resultant of the colours of the displayed images is the 
resultant of the colour in the source image. 

The luminance of the displayed Images is preferably equal to the 
10 luminance in the source image. The colour of a pixel is in general defined by 
the chrominance of said pixel. 

According to one embodiment, the display rate is greater than the 
frequency for colour fusion by the human eye, for example greater than 20 
Hz. 

15 Other features and advantages of the invention will become 

apparant in the light of the detailed description that is given with reference to 
the appended figures in which: 

- Figure 1 shows a diagram illustrating the principle of a first 
embodiment of the Invention; 

20 - Figure 2 Is a representation in a colour plot of the processing 

carried out in the first embodiment; 

- Figure 3 shows a diagram Illustrating the principle of a second 
embodiment of the Invention; and 

- Figure 4 Is a representation in a colour plot of the processing 
25 carried out in the second embodiment. 

The description below will be given within the context of images 
coded in digital form, but the invention is of course not limited to this type of 
coding. Within this context, the image or images to be displayed are 
described by data stored in a data medium 2, such as an optical disk, a hard 
30 disk or a magnetic tape. This data may also come from a broadcasting 
channel (for example, radio, satellite, cable or ADSL). The display system 4 
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receives this data in the form of a source stream, which thus represents the 
image or the sequence of images to be displayed. 

According to a first embodiment shown in Figure 1, each image li 
of the source stream gives rise to the display of two images I3 and U on the 
5 display device (for example a projector 8 with a screen 10). In the case of 
moving images, the display rate is therefore twice the image rate in the 
source stream. Moreover, it may be pointed out that this embodiment, which 
could use only a single source image h, applies of course to the case of a 
fixed image. 

10 The source image U is converted in succession into two displayed 

Images I3, U by a processing circuit 6, the operation of which will now be 

described in detail. 

Overall, the processing circuit 6 makes it possible to modulate the 

colour of the pixels with a feature, while maintaining their luminance, that is to 
15 say the light intensity of each pixel, at the level defined in the source image. 

The processing circuit therefore leaves unchanged the values of the pixels 

located away from the feature. 

in theory, the feature is any set of pixels. In practice, it may define 

a message that the modulation could cause to appear if it were to be filmed 
20 by a camcorder. It would even be possible to provide for the feature to 

comprise all of the pixels of the Image, which would considerably degrade the 

image in the event of illegal recordings; however this solution may be 

irksome In the case of large screens because of the higher flicker sensitivity 

in the peripheral regions of the eye. 
25 The processing carried out on each pixel P of the feature, defined 

in the source image by the triplet Ri, Gi, Bi according to the commonly used 

RGB standard, will now be described, each value being, for example, coded 

over 8 bits (between 0 and 255). 

To carry out the colour modulation at constant luminance in a 
30 precise manner, a colorimetric space of the luminance/chrominance type is 

defined, for example the space YUV. Within this new reference frame, the 

colorimetric coordinates of the pixel P are here: 
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Yi = 0.3 * + 0.59 * + 0.11 * 

= - 0.17 * - 0.34 * + 0.51 * +128 
V, = 0.51 * R, - 0.43 * G, - 0.082 * B^ + 128. 

Preferably, an inverse function of the conventional gamma function 
is applied so as to work in a linear digital space relative to the display space. 

As already mentioned, the processing circuit 6 preserves the 
5 luminance of the displayed images at the luminance of the source signal h. In 
the case of pixel P, the luminance Y3 in the image I3 and the luminance Y4 in 
the image U will therefore be simply defined by: 

Y3 = Yi and Y4 = Yi. 
In contrast, the chrominance components Ui, Vi are modified by 
10 the processing circuit so as to degrade the image such that it could be picked 
up by a camera. However, measures are taken to ensure that the images I3 
and I4 follow each other at a rate higher than the frequency for colour fusion 
and that the modified colours offset each other in order to obtain the desired 
colour (defined in the source image). 
15 These constraints are reflected in the following general equations 

in which U3, V3 are the chrominance components of the pixel P in the image 
I3 and U4, V4 are the chrominance components of the pixel P in the image 

U3 = g(Ui.Vi)and V3 = h(Ui.Vi) 
(U3 + U4)/2 = Ui 

20 (V3 + V4)/2 = Vi. 

Represented in a conventional chromaticity plot as in Figure 2, the 
last two equations indicate that the colour Ci (with coordinates Ui, Vi) that 
the display device has to present to the eye at the point P is obtained by the 
fusion by the eye of the colours C3 (with coordinates U3. V3) and C4 (U4, V4) 

25 actually displayed. 

More precisely. Figure 2 shows the various colours considered in 
the (O, U, V) plane. In the representation over 8 bits given here by way of 
example, the point with coordinates (128, 128) corresponds to grey. In this 
plot, the saturation therefore increases with the distance from the point of 

30 coordinates (128, 128). 
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From the above equations, the point Ci is the nniddle of the 
segment C3C4. so that the resultant for the eye of the colours C3 and C4 that 
are actually displayed is the colour Ci. We speak here of the middle owing to 
the fact that the colours C3 and C4 are displayed for the same period (for 
5 example around 20 ms). Of course, a system could also be provided in which 
the display time can vary from one image to another; in this case, the 
resultant colour for the eye would be the barycentre of the colours actually 
displayed, weighted by the display time of each colour. 

For one particularly simple case, it is possible to use the function f 
10 defined by: 

'if0^;c<63 /(*)=2jc 
.if63<x<192 /(x) = 128 
if 1 92 ^ a: < 255 f(x) = 2jc- 255 

and to determine the colorimetric coordinates of the point P in the image I3 by 
U3 = f(Ui) and V3 = f(Vi), limiting however the values of U3 and V3 according 
to the following inequations so that none of the triplets (Y3, U3, V3) and (Y4, 
15 U4. V4) lies outside the space addressable in RGB over 8 bits: 

255 -B^ 



Ut- 



1.73 



^ U3 5 U,+ 



.36 
1.73 



Y 255 - Y 



128- 



Vi — [Gi- 0.33 * (Ui- Uj)] ^ V3 ^ V,+ —=— [255 - [Gj- 0.33 * (U^- U 



0.69 



0.69 



20 Once the colorimetric coordinates U3. V3 of the pixel P in the image 

I3, have been calculated, the colorimetric coordinates In the image U are 
easily obtained by the above general equations which give: 

U4 = 2. Ui - U3 and V4 = 2. Vi - V3. 
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Thus, the colorimetric coordinates of the pixel P of the images I3 
and I4, are completely detennined, this calculation having to be carried out 
with the set of pixels of the feature. 

Of course, before the displaying, these values are expressed in the 
5 reference frame used by the display device 8, here by applying the 
conventional gamma function and then retuming to the RGB reference frame 
using the following equations: 

R = Y+1.36*(V-128) 
^G = Y - 0.33 *(U- 128)- 0.69 *(V- 128) 
B = Y+ 1.73 *(U- 128). 

The images I3 and U are therefore displayed in succession by 

10 means of the display device, for example for an identical time of around 20 
ms. As was seen above, the display time could be different for each image. 

Of course, in the case of the display of a fixed image, the 
successive displaying of the images I3 and U will be periodically refreshed. 

The use of the function f as indicated above will result in a strong 

15 desaturation of the pixels of the feature in the image I3 and a corresponding 
supersaturation of the pixels of the feature in the image U. As indicated 
above, since the images I3 and U are displayed in succession at a rate (for 
example 50 Hz) that is higher than the frequency for colour fusion by the 
human eye, the resulting colour perceived by the human eye at the feature is 

20 the colour Ci contained in the source image I3 and the feature is therefore 
invisible to the human eye. 

In contrast, the rendering will be degraded appreciably for a 
camera not synchronized with the display since the colours in the filmed 
image (I3 or U) will be false (desaturated or supersaturated) in the feature. 

25 A second embodiment of the invention proposes to process 

images of the source stream in pairs and, for each pair of images thus 
considered, to generate as output two modified images for the purpose of 
displaying them. This embodiment is therefore suitable for the case in which 
the sourced stream rate is equal to the display rate. 



30 
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As shown in Figure 3. the images of the source stream coming 
from the data medium 2 are grouped together in pairs of successive images 
li, 12. Each pair U, I2 is processed by the processing circuit 6 as indicated in 
detail below so as to obtain an image pair I3, I4 for display (by the display 
5 system 8, 10 as previously). Successive display of the images I1 and I2 is 
carried out at a higher rate than the frequency for colour fusion by the human 
eye (without being necessarily higher than the flicker fusion frequency). For 
example, a display rate of 50 Hz will be adopted. 

The processing circuit 6 modifies the chrominance of the pixels of 
10 a predetemiined feature, as explained in detail below, but leaves unchanged 
the values (for example the RGB values) relating to the pixels located outside 
the features. 

For each pixel P of the feature, the RGB colorimetric values of 
which (coded over 8 bits) in the source flux are respectively Ri, Gi, Bi in the 
15 case of the first image h and R2, G2, B2 in the case of the second image I2, 
the following processing steps are carried out: 

- transition into a luminance/chrominance-type colorimetric space 

using formulae of the type: 

Y = 0.3 * R + 0.59 * G + 0.11 * B 
^ U = - 0. 17 * R - 0.34 * G + 0.51 * B +128 
y = 0.51 * R - 0.43 * G - 0.082 * B + 128 

20 so as to obtain the colorimetric coordinates Yi, Ui, Vi and Y2, U2, V2 of the 
pixel P in the images h and I2 ; 

- application of an inverse gamma function; 

- preservation of the luminance and modification of the 
chrominance components, while still keeping an average chrominance equal 

25 to the average chrominance in the source image (averages effected over the 
number of images taken into account, in this case over the image pairs h, I2 
and I3, U). This step may be described by the following general formulae: 

Y3 = Yi and Y4 = Y2 
U3 = g(Ui, Vi, U2, V2) and V3 = h(Ui, Vi, U2. V2) 
30 U3 + U4 = Ui+ U2 
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V3 + V4 = Vi+ V2 ; 
- application of the gamma function to the colorimetric coordinates 
determined, Y3, U3, V3 and Y4. U4, V4. of the pixel P in the images I3 and I4 
respectively; and 



practice the simplified approach consisting in using the function f defined 
10 above (as particular g and h function) and to take U3 = f(Ui) and V3 = f(Vi). 

However, as previously, the excursion of the U3 and V3 values is 
limited using the following inequalities in such a way that R3, G3, B3 and R4, 
G4, B4 remain within limits addressable over 8 bits. i.e. between 0 and 255: 



- return to the RGB-colorimetric space (used for the display) using 
the general formulae: 



'R=Y+1.36*(V-128) 
^ G = Y - 0.33 * (U- 128) - 0.69 * (V- 128) . 
B = Y+1.73*(U-128). 



As in the case of the first embodiment, it is possible to use in 



128- 



1.36 



:S V3 ^ 128 + 



255 - Y, 
1.36 



128- 



1.73 



< U3 ^ 128 + 



255 - Y^ 
1.73 



15 



.[v.. 510-(R.^^R^^Y.-YJ j ^ ^ ^^^^:^] 



ik+ Vj- o;^[G,+ Y,- Y . - 0.33 * (U,+ Uj- Z.U,)]] S 




20 Thanks to the processing described above, the feature will appear 

to the human eye with a colour identical to the colour that would appear to 
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the eye by direct use of the source stream (i.e. the colour resulting from the 
colour fusion of the images li and b). 

In contrast, a camcorder filming the images in a random manner 
will record modified colours for the pixels of the features, which will make the 
5 copy thus produced unacceptable owing to the unsatisfactory mixing of the 
modified colours. 

This embodiment, illustrated in Figure 4 in a plot similar to that of 
Figure 2, proposes that the resultant of the colours actually displayed (C3 and 
10 C4) corresponds to the resultant of the desired colours (Ci and C2) in the 
source image, that is to say the middle of the segment C3C4 coincides with 
the middle of the segment C1C2. 

Of course, the invention is not limited to the embodiments 
15 described above. In particular, it is possible to choose functions g and h other 
than the function f used above. For example, functions may be chosen that 
desaturate only one of the components of the image I3 and the other 
component in the image U (for example using fomnulae of the type U3 = f(Ui) 
and V4 = f(Vi)). 

20 

Likewise, as described by the use of the general functions g and h, 
the two components U and V are not necessarily processed in an analogous 
manner. For example, It is possible to limit the variations made on the 
component U so as to limit the blue flicker, to which the eye is relatively more 
25 sensitive. 



